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METHOD AND SYSTEM FOR GESTURAL CONTROL OF AN 

APPARATUS 

The present invention relates to a method and a device for controlling 
an apparatus equipped with a display screen such as a microcomputer or a 
television set, or a projection device. 

In particular, but not exclusively, it applies to control of an apparatus 
5 through the intermediary of a pointer displayed on a display screen or to the 
selection of display zones on such a display screen. 

In order to displace a pointer on a display screen or to select display 
zones, systems have been developed such as a mouse, a touch sensitive 
surface, joystick or tracker ball or also button assemblies. There are also 
10 remote controls provided with control keys, communicating with the system 
controlling the display screen through the intermediary of an infirared, radio or 
ultrasound link. 

Nonetheless, these systems have many limitations related, in particular, 
to ergonomics. 

15 In fact, most of these systems (mouse, sensitive surface, joystick, 

tracker ball) have the disadvantage of needing a horizontal surface in which 
they can be set, and usually have to be close to the apparatus being controlled, 
so that they are poorly adapted to public presentations. 

Systems have also been developed that are able to detect user 

20 movements with sensors carried by the user or connected to the apparatus 
being controlled. Such a system is described for example in the patent 
US 6 275 214. This system operates a camera connected to the apparatus being 
controlled and a laser pointer carried by the user, which projects a laser spot 
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on a display screen which is detected by an image analysis system connected 
to the camera. In order to reproduce the functioning of a mouse and in 
particular mouse buttons making it possible to introduce, in particular, 
validation controls of a choice or of a position, the laser pointer comprises 
5 control buttons to modify the shape or color of the spot projected onto the 
screen. This solution has the disadvantage of being relatively costly to apply, 
because of the use of a camera and a controllable laser pointer able to modify . 
the color or the shape of the spot Furthermore, in order to be completely 
portable and mobile, the laser pointer must be equipped with its own energy 
10 supply, meaning that its autonomy decreases accordingly as its dimensions are 
reduced. 

Patent US 5 703 623 describes a pointing device mcluding movement 
sensors according to three axes to detect changes of position and/or 
orientation, and calculation means coupled with the movement sensors. 
15 Patent US 5 737 360 describes a control device for elements displayed 

on a screen, this device including a control box ovoid in shape intended to be 
hand-held and enclosing accelerometers intended to detect certain movement 
patterns of the hand. 

The patent application WO 00/63874 describes a pointing device 
20 intended to be hand-held and designed to detect a displacement (an 
acceleration) in the three dimensions without contact with a surface, and to 
detect the pressxire of the user's hand. This device is designed to be coimected 
by a wire link to a computer, which limits utilization possibilities. 

All these devices are bulky and costiy to manufacture, and when they 
25 do not have a wire link they have limited autonomy. 

The aim of the present invention is to overcome these disadvantages. 
This aim is achieved by providing a remote control method for an apparatus, 
using a control device carried by the user, and comprising steps of: 

- measuring the movements of the control device along at least one first 

30 axis; 

- defining the cotnmands to be apphed to the apparatus being controlled 
as a function of movement measurements of the control device, and 

- applying commands to the apparatus being controlled. 

According to the invention, this method includes steps dming which the 
35 control device transmits the movement measurements and radio-electric 
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signals to a processing device connected to the apparatus being controlled, and 
the processing device: 

- receives movement measurements and radio-electric signals from the 
control device through the intermediary of at least first and second antennas 

S spaced out along a second axis non-parallel to the first axis; 

-demodulates in synchronous manner with a reference signal, the 
radio-electric signals received by the first and second antennas respectively, 
and 

- defines the commands to be applied to the apparatus being controlled, 
10 the commands comprising displacement information along at least the second 

axis, determined as a fimction of demodulated signals, and information about 
control activation defined as a fimction of the movement measurements along 
the first axis, received from the control device. 

According to a preferred embodiment of the invention, the movement 

15 measurements along the first axis, jmdc by the control device, are 
measurements of the control device acceleration along the first axis, tihie 
processing device defining the information about command activation by 
comparing the acceleration measured with at least one predefined threshold 
According to a preferred embodiment of the invention, the processing 

20 device receives the radio-electric signals emitted by the control device through 
the intermediary of at least one third antenna separated from the first and 
second antennas along a third axis non-parallel to the first and second axes, 
and determines displacement information from the control device following 
the third axis, by measuring the phase shifts between the reference signal and 

25 the radio-electric signals received by the processing device through the 
intermediary of the third antenna. 

According to a preferred embodiment of the invention, this method 
fiirthennore includes a step of periodic transmission of an activation radio- 
electric signal to the control device, the steps of measurement and 

30 transmission of the control device movement measurements being carried out 
only after receiving the activation signal. 

According to a preferred embodiment of the invention, this method 
fiirthennore comprises steps of: 

- transmitting an activation radio-electric signal to the control device; 
35 - doubling the frequency of the activation signal by the control device 

to obtain a carrier having a frequency twice that of the activation signal; 
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-modulating the carrier to transmit control device movement 
measxirements to the processing device, and 

- generating the reference signal by the processing device consisting of 
doubling the frequency of the activation signal. 

S Altematively, movement measurem^ts along at least the first axis are 

transmitted by the control device under the form of light signals. 

The invention also concerns a remote control system for an apparatus, 
the control system comprising a control device caitied by the user and 
communicating with the apparatus to be controlled, the control device 
10 comprising means for measuring its movements along at least a first axis. 

According to the invention, the control device comprises means for 
emitting movement measurements and radio-electric signals, the system 
further comprising a processing device connected to the apparatus to be 
controlled and to at least the first and second antennas spaced out along a 
15 second axis non-parallel to the first axis, and receiving the radio-electric 
signals emitted by the control device, the processing device including: 

- means for receiving movement measurements emitted by the control 
device; 

- means for demodulating in a synchronous manner with a reference 
20 signal, the radio-electric signals received from the control device respectively 

by the intermediary of the first and second antennas; 

- means for determining the displacement information along at least the 
second axis as a function of the measured phase shifts; 

- means for determining control activation information as a function of 
25 movement measurements along the first axis, received from the control device, 

and 

- means for detenxiining commands to be applied to the apparatus to be 
controlled, from control displacement and activation information. 

According to a preferred embodiment of the invention, the control 
30 device includes means for measuring the acceleration of the control device 
along the first axis, and for transmitting the acceleration measurements along 
this axis to the processing device, the processing device including means for 
comparing acceleration measurements received at a predefined threshold, to 
determine control activation information. 
35 According to a preferred embodiment of the invention, the processing 

device comprises at least a third antenna set spaced out from said first and 
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second antennas along a third axis non-parallel to the first and second axes, 
means for measuring phase shifts between the signals received by the third 
anteima and the reference signal, and means for determining a displacement of 
the control device along the third axis, as a function of the phase shifts 
5 measured by the phase shift measurement means. 

According to a preferred embodiment of the invention, the control 
device comprises means for transmitting movement measurement signals 
along at least the first axis by modulation of the radio-electric signals. 

According to a preferred embodiment of the invention, the processing 
10 device comprises means for periodic transmission of an activation radio- 
electric signal to the control device, the control device comprising means for 
detecting reception of the activation signal, means for being at least partially 
off-line in the absence of detection of an activation signal, and means for 
activating signal transmission to the processing device for a predefined length 
1 5 of time following.reception of the activation signal. 

Advantageously, the control device comprises a frequency doubler to 
which the activation signal is appUed for generating a carrier having a 
frequency twice that of the activation signal, and means for modulating the 
carrier as a function of movement measurements along at least the first axis, 
20 and means for emitting the modulated carrier in the form of radio-electric 
signals, the processing device comprising a frequency doubler for generating 
the reference signal from the activation signal. 

Alternatively, the control device comprises means for transmitting the 
movement measurement signals from the control device along at least the first 
25 axis in the form of light signals. 

According to a preferred embodiment of the invention, the control 
device comprises a switch for putting it off-line. 

According to a preferred embodiment of the invention, the control 
device has a shape such that it can be attached onto one of the user's fingers. 
30 Preferably, the control device comprises a switch for putting it off-line, 

set in such a way that it is on-line only when it is attached to one of the user's 
fingers. 

Preferred embodiments of the invention will be described below, as 
non-limiting examples, with reference to the attached drawings in which: 
35 - figure 1 shows diagrammatically a control system according to the 

invention; 
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- figures 2a and 2b show in more detail a first embodiment respectively 
of the control device and the processing device of the control system shown in 
figure 1; 

- figures 3a and 3b show a second embodiment respectively of the 
5 control device and the processing device of the control system shown in 

figure 1; 

- figures 4a and 4b show a third embodiment respectively of the control 
device and the processing device of the control system shown in figure 1 . 

Figure 1 shows a control system of an apparatus 40, in particular an 
10 apparatus associated with an image display, such as a computer or a television 
set, provided with a display screen 41 or a video projector. This system 
comprises a control device 1 intended to be worn by the user and designed to 
emit movement signals, a processing device 20 designed to receive and 
process the movement signals emitted by the control device to define controls 
15 to apply to the apparatus being controlled 40, the processing device 20 then 
being connected to the apparatus being controlled. 
In figure 2a, the control device 1 comprises: 

-movement sensors 8, such as an accelerometer with two axes, to 
measure the movements of the control device, applied by the user along two 
20 axes, that is a vertical axis Y and a horizontal axis Z perpendicular to the plane 
of the display screen 41 ; 

- a send-receive antenna 12 for receiving an activation signal emitted by 
the processing device 20 and in response emitting signals providing movement 
measurements measured by the movement sensors 8; 

25 -a directional coupler 2 connected to the anteima 12 to orient the 

activation signal picked up by the antenna and apphed to a first terminal 
towards a second teraiinal connected to a detection circuit 3 tuned to the 
firequency F of the activation signal, and to orient the appUed signals to a third 
terminal towards the first terminal; 

30 - a fi:equency doubler in quadrature 5 coimected to the detection circuit 

3 and providing, on two outputs respectively, two signals I and Q having a 
frequency 2F which is twice the frequency F of the activation signal, in phase 
and in phase quadrature respectively; 

- two modulators 6, 7 for example of annular type, receiving as input 
35 the signals I and Q and the movement values measured by the movement 
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sensors 8 to modulate the signals I and Q with the measured movement values, 
and 

- a sunmiing amplifier 4 connected to two modulators 6, 7 designed to 
add and amplify the modulated signals I and Q, the output of the summer 

5 being connected to the third terminal of the coupler 2 so that the modulated 
signals I and Q are emitted by the antenna 12. 

The movement sensors can also be of the gyroscope type or can be 
designed to detect movements by measuring the Doppler effect on the 
received signal. 

10 To modulate the signals in quadrature I and Q at frequency 2F, the 

measurement signals emitted from the movement sensors 8 are, for example, 
periodic square signals whose cyclic factor varies as a function of the 
measured acceleration, this cyclic factor being, for example, equal to 50% in 
the absence of acceleration and varying from + or - 10% per g of acceleration, 
15 along the acceleration direction applied to the control device 1 . 

The fact of using a carrier frequency 2F for transmission of 
measurements equal to double the frequency F received, makes it possible to 
avoid Larsen effects. 

The control device 1 is fed by a supply current comprising an 
20 autonomous continuous voltage source 10. Advantageously, the supply 
voltage is applied to the different components of the control device through 
the intermediary of a supply control circuit 9 receiving as input a detection 
signal sent by the detection circuit 3. In this way, the control device 1 is active 
only when it receives the activation signal emitted by the processing device 
25 20. One can envisage inserting a condenser 1 1 in the supply control circuit 9, 
making it possible to maintain the supply voltage for a certain time period 
after the end of reception of the activation signal. 

As a result of these settings, the control device 1 has low electrical 
consunq)tion. It can therefore be supplied by a small sized battery and still 
30 have high autonomy. 

In figure 2b, the processing device 20 comprises: 

- a generator 26 for the activation signal at frequency F, this circuit 
being coupled to a transmitter antenna 36 and connected to a frequency 
doubler in quadrature 27 supplying two reference signals I and Q at frequency 

35 2F in phase and in phase quadrature respectively; 
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- two receiver antennas 34, 35, preferably separated from each other, to 
receive the signals emitted by the control device 1, these antennas being 
connected to a band-pass filter 32, 33 respectively, centered on the frequency 
2F; 

5 - two synchronous demodulators 28, 29 receiving an input reference 

signal I at frequency 2F emitted by the doubler in quadrature 27 and 
respectively the output signals from the filters 32, 33 and delivering output 
signals of acceleration measurement along the axis Y 

-two synchronous demodulators 30, 31 receiving an input reference 
10 signal Q at frequency 2F emitted by the doubler in quadrature 27 and 
respectively the signals from the filters 32, 33 and delivering output signals of 
acceleration measurement along the axis Z; 

- four samplers 22 to 25 to sample the acceleration measurement signals 
emitted respectively by the four demodulators 28 to 3 1, and 

15 - a processor 21, for example of the microprocessor type, for treating 

the sampled measurement signals emitted by the samplers 22 to 25, and thus 
defining a coromand to be applied to the apparatus being controlled 40, and to 
command the generator 26 to trigger emission of the activation signal 
periodically. 

20 The processor 21 is programmed to trigger the emission of the 

activation signal over a time length corresponding to the period necessary for 
the accelerometers to provide a measurement, and with adequate periodicity, 
taking into account the speed of variation of the acceleration likely to be 
measured. 

25 The link between the control device 1 and the processing device 20 can 

be a radio link. In this case, the reference frequency F of the activation signal 
is preferably chosen within the interval between 400 MHz and 800 MHz, for 
example equal to 433 MHz. 

It can also be provided a switch 13 in series with the continuous voltage 
30 source 10 of the control device 1, that can be activated by the user to control 
the powering of the device. 

The control system described jxist above acts in the following way. 
The processor 21 of the processing device 20 controls the generator 
such that it transmits periodically an activation signal (at frequency F) for a 
35 time period of, for example, of the order of 5 min. 
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Detection of this activation signal picked up by the antenna 12, by the 
detection circuit 3 of the control device 1, triggers application of the supply 10 
to the control device components for a time period of about 5 minutes, fixed 
by the value of the condenser 11. Furthermore, the received signal is filtered 
5 by the detector then processed by the doubler in quadrature 5 which provides 
the two sinusoidal signals in quadrature I and Q at frequency 2F. In the 
modulators 6 and 7, the square signals I and Q delivered by the accelerometer 
8 modulate, for example in phase, the signals I and Q used as carriers. The 
modulated signals are then summed and amplified by the circuit summer 
10 amplifier 2, then applied as input for coupler 2 to be emitted by the antenna 
12. 

The modulated frequencies, summed at frequency F, are received by 
antennas 34 and 35 of the processing device 20. In parallel, the signal at 
frequency F generated by the generator 26 is processed by the doubler in 

15 quadrature 27 which generates reference signals in quadrature I and Q at 
frequency 2F. These signals are used to demodulate in synchronous manner 
the signals received by antennas 34 and 35 and filtered respectively by filters 
32, 33. This demodulation carried out by the four demodulators 28 to 31 
makes it possible to obtain four signals Yd, Yq, Zd, Zq, which are sampled and 

20 applied as input to the processor 2 1 . 

The command defined by processor 21 can comprise information about 
displacement in the XY plane and command activation information as a 
function of the acceleration measured along the horizontal axis Z. 

The displacement information along the vertical axis Y is obtained from 

25 one of the signals sampled, Yq or Yd, where the weightless value g has been 
removed and by making a double integration of the value of the resulting 
acceleration. The displacement information along an axis X parallel to the axis 
passing the two antennas 34, 35, and preferably horizontal and parallel to the 
display screen 41, is obtained from the phase shift that the processor 21 can 

30 measure between the sampled signals Yq and Yd, or Zq and Zd 

The conmiand activation information is, for example, binary 
information obtained by comparison with an acceleration threshold measured 
along axis Z. In this way, the user can trigger the activation of a control by 
applying a movement simulating a pressure movement to the control device 1 

35 on a control key. 
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Processing of acceleration information is thus carried out by the 
processing device 20 that is fixed and connected to the apparatus being 
controlled. As a result the control device 1 comprises a small number of 
components (no microprocessor). It can thus be integrated into a small- 
5 dimensioned box, for example in the shape of a thimble, or a ring, that can be 
slipped onto a user's finger with which the user simulates displacement and 
control movements. In this case, the switch 13 can advantageously be set 
inside the thimble so as to be in a closed position only when the user inserts a 
finger. 

10 Figures 3a and 3b represent a second preferred embodiment of the 

control device and the processing device of the control system according to the 
invention. In these figures, acceleration measurements along axes Y and Z are 
transmitted between the control device la and the processing device 20a in the 
form of light signals, for example in the infrared field, whereas the bi- 

15 directional radio link between these two devices is preserved both for 
transmission of the activation signal from the control device la and for 
determining a displacement along a third axis X by measuring the phase shift 
of the signals produced by the control device and received by two antennas set 
along axis X. 

20 In figure 3a, the control device comprises two light emitters 41, 42, for 

example electro-luminescent diodes, receiving respectively the signals for 
acceleration measurement along the Y and Z axes delivered by the 
accelerometer 8. Compared to the control device 1 shown in figure 2a, the 
device la thus comprises a simplified activation circuit including a single 

25 frequency doubler 45, connected to the output of the signal detector 3 tuned to 
the frequency F of the activation signal, and an amplifier 44 connected to the 
output of the doubler 45 to amplify the signal at frequency 2F produced by the 
doubler and to apply it to the input of title coupler 2 so that it is emitted by the 
antenna 12. 

30 The emission wavelengths of the two emitters 41, 42, are different, such 

that they can be received separately by the processing device. 

The control device la shown in figure 3a is adapted to the processing 
device 20a shown in figure 3b. This processing device comprises two Ught 
signal receivers 51, 52, adapted for detecting the signals emitted respectively 

35 by emitters 41 and 42, these receivers being for example light detection diodes 
sensitive in the respective wavelength ranges transmitted by emitters 41, 42. 
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The processing device 20a also has simplified architecture compared to 
that described with reference to figure 2b. In fact, it comprises a single 
frequency doubler 53 linked to the output of the frequency generator 26 for 
generating a reference signal at frequency 2F, two synchronous demodulators 
5 28, 29 (instead of four) receiving as input the reference signal at fi^equency 2F 
provided as output fi-om the doubler 53 for demodulating the signals received 
by the antennas 34, 35, and filtered by filters 32, 33, two samplers 22, 25 
(instead of four) for sampling respectively the demodulated signals fi:om the 
demodulators, the outputs of the demodulators being linked to respective 

10 iiq)uts of the processor 21. In this control system, the accelerations along the 
axes Y and Z are transmitted in the form of ligjit signals, while information 
about displacement along an axis X linking two antennas 34, 35, is deduced, 
as in the first embodiment, firom the phase shift between the radio signals 
received by the two antennas 34, 35, spaced along the axis X. 

15 Figures 4a and 4b show a third preferred embodiment of the control 

device and the processing device. In these figures, the control device Ic 
comprises an accelerometer 81 providing acceleration measurements along a 
single axis Z that are transmitted to the processing device 20c in the form of 
light signals, for example in the infi^ured range, while the bi-dhrectional radio 

20 link between these two devices is kept for bofli the transmission of the control 
device activation signal Ic and for determioing a displacement along axes X 
and Y by measuring the phase shift of the signals sent firom the control device 
Ic and received by two pairs of antemas of the processing device 20c, set 
respectively along axes X and Y. 

25 In figure 4a, the control device Ic has practically the same architecture 

as the control device la shown ki figure 3a, apart from the fact that it includes 
an accelerometer 81 with a single axis for measuring an acceleration along the 
Z axis, this measurement modulating a light signal emitted by a Ught emitter 
82. 

30 In figure 4b, the processing device 20c comprises four directive 

antennas 84 to 87, for example of tiie loop type, set respectively along the axes 
X and Y, and which are linked respectively to the demodxdators 28 to 31, 
possibly through the intermediary of respective band pass filters 88 to 91 
centered on the fi-equency 2F, the outputs from the demodulators being linked 

35 to the processor 21 through the intermediary of the samplers 22 to 25. In this 
way, the processor can determine information about displacement along the 
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axes X and Y by determining the phase shift between the radio signals 
received on the one hand by the antennas 84 and 86 and on the other hand by 
the antennas 85 and 87. 

Evidently, it is possible to use only three antennas, regrouped in two 
5 antennas pairs set respectively along the axis X and along the axis Y. 

In the same way as in the embodiment shown in figure 3b, the 
processing device 20c also conq)rises a single frequency doubler 53, linked to 
the output from the frequency generator 26 for generating a reference signal 
emitted by the antenna 36 and applied to an input of the synchronous 
10 demodulators 28 to 3 1 . 

The processing device 20c furthermore comprises a detector 83 linked 
to the processor 21 so as to receive light signals related to the acceleration 
along the axis Z, transmitted with the aid of the emitter 82 of the control 
device Ic. 

15 The acceleration measurement along axis Z can also be transmitted in 

tihie form of a radio signal as in the first embodiment of the invention shown in 
figures 2a and 2b. In this case, the acceleration measurement along the axis Z 
is transmitted by modulating the signal from the frequency doubler 45 before 
applying it to the amplifier 44. 



